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Abstract. Let G be a semigroup of rational functions of degree at least two 
where the semigroup operation is composition of functions. We prove that 
the largest open subset of the Riemann sphere on which the semigroup G is 
normal and is completely invariant under each element of G, can have only 0, 
1, 2, or infinitely many components. 



1. Introduction 

It is well known in iteration theory that the set of normality of a rational function 
can have only 0, 1, 2, or infinitely many components (see Q, p. 94). In this paper 
we generalize this result by showing that the completely invariant set of normality 
of a rational semigroup can have only 0, 1, 2, or infinitely many components. The 
proof not only generalizes the iteration result, but it also provides an alternative 
proof for it. 

The results of this paper appear as part of the author's Ph.D. thesis, written 
under the supervision of Aimo Hinkkanen. 

2. Definitions and basic facts 

In what follows all notions of convergence will be with respect to the spherical 
metric on the Riemann sphere C. 

A rational semigroup G is a semigroup of rational functions of degree greater 
than or equal to two defined on the Riemann sphere C with the semigroup operation 
being functional composition. When a semigroup G is generated by the functions 
{A, /2, ...,/„,...}, we write this as 

G = (fx, h-, ■ ■ ■ , fn, ■ ■ ■ )■ 

In ||, p. 360 the definitions of the set of normality, often called the Fatou set, 
and the Julia set of a rational semigroup are as follows: 

Definition 1. For a rational semigroup G we define the set of normality of G, 
N(G), by 

N(G) = {z G C : there is a neighborhood of z on which G is a normal family} 
and define the Julia set of G, J(G), by 

J(G) = C\ N(G). 



1991 Mathematics Subject Classification. Primary 30D05, 58F23. 
Key words and phrases. Rational semigroups, completely invariant sets, Julia sets. 
Research supported by a Department of Education GAANN fellowship and by the Research 
Board of the University of Illinois at Urbana-Champaign. 



1 



2 



RICH STANKEWITZ 



Clearly from these definitions we see that N(G) is an open set and therefore its 
complement J(G) is a compact set. These definitions generalize the case of iteration 
of a single rational function and we write N((h)) — and J ((h)) = Jh- 

Note that J(G) contains the Julia set of each element of G. In fact, we have 
J(G)=UJ^T f (see§, P . 365). 

Definition 2. If h is a map of a set Y into itself, a subset X of Y is: 

i) forward invariant under h if h(X) C X; 
ii) backward invariant under h if h^ 1 (X) C X; 
Hi) completely invariant under h if h(X) C X and h _1 (X) C X. 

It is well known that the set of normality of h and the Julia set of h are completely 
invariant under h (see [Q, p. 54), in fact, 

(2.1) h(N h ) =N h = h~\N h ) and h(J h ) = J h = h~\j h ). 

Further, we have the following result. 

Property 1. The set Jh is the smallest closed completely invariant (under h) set 
which contains three or more points (see [EL p. 67). 

In fact, this may be chosen as an alternate definition of Jh, equivalent to that 
given in Definition [H 

From Definition [H we get that N(G) is forward invariant under each element 
of G and J(G) is backward invariant under each element of G (see pj, p. 360). 
The sets N(G) and J(G) are, however, not necessarily completely invariant under 
the elements of G. This is in contrast to the case of single function dynamics as 
noted in ( j2.l| ). The question then arises, what if we required the Julia set of the 
semigroup G to be completely invariant under each element of G? We consider in 
this paper the consequences of such an extension, given in the following definition. 

Definition 3. For a rational semigroup G we define the completely invariant Julia 
set of G, E — E(G), by 

E(G) = f^iS : S is closed, completely invariant under each g G G, #(S) > 3} 

where #(S) denotes the cardinality of S. 

We note that E(G) exists, is closed, is completely invariant under each element 
of G and contains the Julia set of each element of G by Property EJ. 

Definition 4. For a rational semigroup G we define the completely invariant set 
of normality of G, W = W(G), to be the complement of E(G), i.e., 

W(G) =C\E(G). 

Note that W(G) is open and it is also completely invariant under each element 
of G. The main result of this paper is the following theorem. 

Theorem 1. For a rational semigroup G the set W(G) can have only 0, 1, 2, or 
infinitely many components. 
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3. Proof of the main result 

Property 2. If E(G) has nonempty interior, then E(G) = C. 

Proof. For a collection of sets A, and a function h, we denote new collections of 
sets by h{A) = {h{A) : A E A} and h~ l {A) = {h,- l {A) :AeA}. 

Choose g E G. Let us define the following countable collections of sets: 

si= U .r 1 ( £ o) u U /( f °)> 

fee fee 
£n+i = (J u (J /(£„), 

/EG /£G 

oo 

and £ = £ n . 

In the same manner as in the proof of Lemma 1 in Q| we conclude E(G) = 
U^ef Using this result we then finish the proof in the same manner as done in 
the proof of Lemma 2 in . □ 

The remainder of this section will be devoted to the proof of Theorem [l]. 

Lemma 1. IfWo is a component ofW, then /(Wo) is also a component ofW for 
any f GG. 

Proof. Let W\ be the component of W that contains /(Wo). We show that /(Wo) = 
W\. Suppose to the contrary that z € W\ \ /(Wo). Since / is continuous on the 
compact set Wq and an open map on Wo, we have df(Wo) C f(dWo) C f(E) C E. 
Let 7 be a path in W\ connecting z to a point w G /(Wo). Hence 7 must cross 
9/(Wo) C E. This contradicts the fact that 7 C Wi and so we conclude that 
/(Wo) = Wl □ 

Since the remainder of this section will be devoted to the proof of Theorem p], 
we will assume that W has L components where 2 < L < +00. We remark here 
that the strategy will be to show that each of the L components of W is simply 
connected and then the result will follow by an application of the Riemann-Hurwitz 
relation. 

Definition 5. Let W have components Wj for j = 0, . . . , L — 1. 

Remark 1. We see by Lemma |] that each / e G (and hence each / _1 as well) 
permutes the Wj for j — 0, . . . , L — 1 since / is a continuous map of W onto W. 

We may assume that 00 G Wo, else we may impose this condition by conjugating 
each / E G by the same rotation of the sphere. 

Definition 6. For j = 1, . . . , L — 1, we define 

Kj = {z £ Wj : there exists a simple closed curve 7 C Wj such that Ind 1 (z) = 1} 

where the winding number is given by Ind^(z) = (l/2wi) J \/{w — z) dw. If z E Kj 
and the simple closed curve 7 C Wj is such that Ind 1 (z) = 1, then we say that 7 
works for z E Kj. 
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In order to properly define Kq we first need to move Wo so that it no longer 
contains oo. Let <f> be a rotation of the sphere so that oo G <fi(Wi) and denote 
Wj =4>{Wj) for j = 0,...,L-l. 

Definition 7. We define 

A'o = {z £ Wq ■ there exists a simple closed curve 7 C Wo such that Ind 1 (z) = 1} 
and 

Ko = 4>- 1 (k )- 

If z G Ko and simple closed curve 7 C Wo is such that Ind 1 ((j){z)) = 1, then we 
say that the simple closed curve cf)" 1 ^) works for z G i^o- 

Remark 2. Note that saying </> _1 (7) works for z G Kq does not necessarily imply 
that Ind^-i m{%) = 1, since it may be the case that Ind-y((f>(oo)) — 1 and hence 
7nd^-i( 7 )(z) = since z lies in the unbounded component of C\ </> _1 (7). 

Definition 8. We define 

L-l 

K= |J Kj. 

3=0 

Definition 9. We define 

w; = w 3 uK r 

Lemma 2. For j = 0, . . . , L — 1, t/ie set is open, connected and simply con- 
nected. Thus each Kj is the union of the "holes " in Wj . 

Proof. Suppose that 1 < j < L — 1, so that Wj is a bounded domain in the complex 
plane. Define A to be the unbounded component of C \ Wj. Hence B — C \ A is 
open, connected and simply connected. 

Let F be a bounded component of C\W/. Since ^4 and F are each components of 
the closed set C \ Wj , there exists a simple polygon 7 C Wj which separates A from 
F (see [|, p. 134). Hence we see that F C Kj . Since F was an arbitrary bounded 
component of C \ Wj , we conclude that Kj contains all the bounded components 
of C \ Wj, i.e., the "holes" of Wj. Hence Wj D B. Clearly Kj cannot contain 
any points of A since any simple closed path 7 C Wj which would wind around 
such a point would have to necessarily wind around every point of A (since A is a 
component of the complement of Wj) including 00 which cannot happen. Hence 
we conclude Wj = B and is therefore open, connected and simply connected. 

We show that </>(Wq) is open, connected and simply connected using the same 
argument as above, and this implies that Wq is open, connected and simply con- 
nected. □ 

Definition 10. We define 

W'=\jW'j. 

3=0 

Note that we have W = W U K . 
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Lemma 3. If for some distinct r, s £ {0, . . . , L — 1}, we have W' r H W' s ^ 0, then 
either W' r C W' s or W' s C W' r . In particular, if W r (~1 W' s ^ for some distinct 
r, s G {0, . . . , L - 1}, then WJ C W' s . 

Proof. Let z £ Wj fl W s '. Since W r fl W s =0, we may assume that z £ K s , say. Let 
7 S work for z G A s . Let I Ja be the component of C \ 7 S which contains z. Note 
that J 7s \ = {z : 7 S works for z} whether or not s = (see Definitions || and |^ 
and Remark ||). Since z £ W' r , we have two cases, either z £ A r or z G W r . 

Suppose that z G A r and let 7 r work for z G K r . As 7 S fl 7 r = (since 
W r nW s = 0) we see that either 7 r C I ls or 7 S C I lr , where I lr is the component of 
C \ 7 r which contains z. By switching the roles of r and s, if necessary, we assume 
7r C I 7s and we note that this can be done since z G K r n A" s . In particular, 
W r n /J ^ 0. 

If z G W r , then we still get W r fl I 7b ^0 since z £ I 7s . 

Since W r fl 7 7s ^ 9, W r nW s — 0, W r is connected, and 7 S C M^s, we conclude 
that W r C / 7s . Hence W r C W 7 ^,' since 7 S then works for every z G W r . Since W' a is 
simply connected we see that W! r C Wj. □ 

Lemma 4. TTie boundary of Wq is a nondegenerate continuum and as such con- 
tains more than three points. 

Proof. We will first show that Wq PI W[ = 0. The set W[ cannot contain Wq as 
oo G Wq and W[ is a bounded subset of C (since W\ is a bounded subset of C). 
The same argument also shows that 4>(Wq) cannot contain 4>(W{) where (f> is as 
in Definition |?], and so we conclude that Wq cannot contain W{ ■ By Lemma ||| we 
conclude that Wq n W[ = 0. 

Since Wq is simply connected, 8Wq contains a nondegenerate continuum unless 
8Wq consists of just a single point. If 8Wq consists of just a single point, then 
Wq 1 U OWq = C, but this contradicts the fact that Wq R W{ = 0. □ 

Lemma 5. For each j = 0, . . . , L — 1, we have Jf C dWj for each f G G, Since 
J(G) = U/gG Jf, we have J(G) C dWj for each j = 0, . . . , L — 1. 

Proof. Since / permutes the Wj by Remark |^, we may select a positive integer 
n so that f n {W 3 ) = Wj = .r n {W 3 ) for each j = 0, ... ,L - 1. Then we have 
yr=i/ _fen (^-) ^ J/- - J/ (see §, p.71 and p.51). But since \J? =1 f-" n (Wj) - 
Vy,- we see that dWj D J/, since W 3 - n J/ = 0. □ 

Lemma 6. FFe have W r ^ /or distinct r, s G {0, . . . , L — 1}, and therefore, by 
Lemma [J, the Wj are disjoint for j = 0, . . . , L — 1. 

Proof. If L = 2, then the proof of Lemma [| shows that Wq n W{ = 0. 

We assume now that L > 3. We will first show that no bounded W' s can contain 
any W r with r 7^ s. Suppose that this does occur. Then there exists a simple closed 
curve 7s C W s such that W r C J 7s where J 7s is the component of C \ 7 S which 
contains the points z such that Ind ls (z) = 1. Hence, by Lemma 0, J(G) C <9W r C 
Wr C 7 7s . But since Wo C C \ I ls we see that J(G) C 9W C Wo C C \ I ls . This 
contradiction implies no bounded W' s can contain any W r . 

We see that Wq cannot contain any W r with r > 1 by the following similar 
argument. If W r C Wq, then there exists a simple closed curve 7 C Wq such that 
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IncL(z) — 1 for every z G W r . Let J 7 be the component of C\7 which contains W r . 
So <j>{J{G)) C <j>(dW r ) = d<t>{W r ) = dW r C J 7 . Since j^cC\/ 7 (recall oo 6 W x ), 
we see that <f>(J(G)) C 0(cWi) = = cWi C C\7 7 . This contradiction 

implies Wq cannot contain any W r with r > 1. □ 



Corollary 1. TTie set if has no interior and therefore each Kj C c?Wj . 

Proof. By Lemma ^ we see that each ifj C E and hence K C E. The Corollary 
then follows from Property |[ □ 



Corollary 2. We have dW = Kj U dW'j. 

Proof. By Corollary |l| we get Kj U <9Wj C dWj. We also have dWj = Wj\Wj C 
\ Wj = (Wj U 9Wj) \ Wj = (Wj U Kj U <9Wj) \ Wj- = Kj U 9Wj. □ 



Lemma 7. We /iaue /(X) C K for all f G G. 

Proof. Let z G if., be such that 7 C Wj works for z. 

Suppose that Wj = f(Wj) ^ Wo. So contains no poles of /, else such a pole 
would be in Wj (by the complete invariance of W under / since 00 6 Wo C W and 
Lemma ^|) and hence fiWj) = Wo- By the argument principle, f(j) C Wi winds 
around f(z), thus f(z) G A'; as /(z) ^ W/ by the complete invariance of W under 
the map /. Note that f{"f) might not work for f(z) G Ki since it might not be 
simple, but f{z) G Ki since it cannot be in the unbounded component of C \ Wi 
and have a curve in Wi, namely /(7), wind around it. 

Now suppose that /{Wj) = W . So (0 o f){W ) = W is bounded and Wj 
contains no poles of <j>o f (else f(Wj) = Wi). So {<j>o f)(j) winds around (<j>o f)(z) 
and hence {<j>o f){z) G A , i.e., f(z) G A . 

So f{Kj) G A and hence we conclude f(K) C K. □ 



Lemma 8. We have for all f G G, f(W') n = 0. vlfeo W' C N(G) and in 
particular K n J(G) = 0. 

Proof. We have /(W) = f(W U K) = f{W) U /(A) C W U K = W'. Since 
W' n <9Wg = (since W' is open), Lemma [| and Montel's Theorem finish the 
proof. □ 

Corollary 3. We have J(G) C <9Wj for each j = 0, . . . , L - 1. 

Proof. This follows immediately from Lemma H, Corollary @ and Lemma pi □ 



Remark 3. It is of interest to note that for any positive integer n there exist disjoint 
simply connected domains D\, . . . , D n in C with dD\ = 9£>2 = • • • = dD n (see j|, 
p. 143). Thus Corollary || does not imply that L < 3 from a purely topological 
perspective. 

Lemma 9. We have f^ x (K) C K for all f G G. Hence by Lemma \% K is 
completely invariant under each f G G. 
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Proof. Let z G K 3 C dWj and say f(w) = z. Define W k = by Remark [| 

We obtain sequences z n G Wj such that z n — > z, and w n G such that iu„ — > w 
and f(w n ) = z n . Hence we see that w G 9Wfc, else w G Wfc and z = /(w) € Wj. 
If w £ Kk, then w G by Corollary 0. Let T be the component of dWj that 
contains f(dWf.). Since z G L, the set F must be one of the components of Kj. By 
Corollary || we see that there exists a ( £ <9W7, n J/. Hence /(C) G ifj PI J/ which 
is a contradiction since we know by Lemma M that K is disjoint from J(G) D Jf. 
This contradiction implies w G Kk and hence / _1 (iir) C X. □ 

Lemma 10. // has L components where 2 < L < +oo, </ien each is simply 
connected. 

Proof. Since K and are each completely invariant under each / G G, so is 
W = W U K . By Lemma || we see that C \ W is completely invariant under each 
/ G G, closed, and contains J(G). Hence E C C \ W. This implies that W = W 
and hence each component of W is then simply connected. □ 

We are now able to present the proof of Theorem 

Proof of Theorem ^|. If W has L components where 2 < L < +oo, then each is 
simply connected by Lemma [l(]. Select a map / G G. Letting n > 1 be selected so 
that each of the components Wj of W is completely invariant under f n , we get by 
the Riemann-Hurwitz relation (see ||, p. 7) 

6 f n(W j )=deg(r)-l 

where we write 5 g (B) = ^2 z& g[v g (z) — 1] and v g (z) is the valency of the map g at 
the point z. 

Hence we obtain 

L-l 

L(degCT) - 1) = 5^ < 5 /"(^) < ^/"(Q = 2(deg(/") - 1) 

3=0 

and so L < 2. The last equality follows from Theorem 2.7.1 in Jl[]. □ 

Remark 4. Note that if L = 2, then each component of is necessarily simply 
connected. 

4. Conclusions 

We know from iteration theory that each of the four possibilities (0,1,2, oo) 
for the number of components of the set of normality can be achieved. So by 
constructing semigroups G such that all the elements have the same Julia set we 
know that the only four possibilities for the number of components of the completely 
invariant set of normality of G can also be achieved. However, it does not seem 
possible that all four possibilities can be achieved if we restrict ourselves to the cases 
where two elements of the semigroup G have nonequal Julia sets. For example, if 
G contains two polynomials with nonequal Julia sets then the completely invariant 
set of normality is necessarily empty (see [Q, Theorem 1). 

We do have the following examples however. 
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Example 1 Let f(z) = 2z — z 1 and g(z) — (z 2 — l)/2z. In this case J/ is a 
Cantor subset of the interval [—1,1] and J g = R, the extended real line. It is shown 
in § that J((f,g}) = ! = £«/, «?)). 

Example 2 Let f{z) — 2z — z^ 1 and g(z) = f(z — 1) + 1. In this case Jf is 
a Cantor subset of the interval [—1,1] and J g = Jf + 1. It is shown in Q that 
J((/,5)) = [-l,2] and £«/,<?))= I. 

So we see that it is possible for a completely invariant set of normality of a 
semigroup G which contains two elements with nonequal Julia sets, to have or 
exactly 2 components. We feel that the interplay between functions with nonequal 
Julia sets and the fact that if E(G) has interior then E(G) = C demands that only 
under special circumstances can we have W(G) be nonempty, when two elements 
of the semigroup G have nonequal Julia sets. 

We state the following conjectures which are due to Aimo Hinkkanen and Gaven 
Martin. 

Conjecture 1. IfG is a rational semigroup which contains two maps f and g such 
that Jf J g and E(G) ^ C, then W{G) has exactly two components, each of which 
is simply connected, and E(G) is equal to the boundary of each of these components. 

Conjecture 2. IfG is a rational semigroup which contains two maps f and g such 
that Jf ^ J g and E{G) ^ C, then E{G) is a simple closed curve in C. 

Of course Conjecture |l| would follow from Conjecture |^. 

We finish by including some comments on the number of components of the 
set of normality N(G) of a rational semigroup G. It is not known if the set N(G) 
must have only 0, 1, 2, or infinitely many components when G is a finitely generated 
rational semigroup. However, for each positive integer n, an example of an infinitely 
generated polynomial semigroup G can be constructed with the property that N(G) 
has exactly n components. These examples were constructed by David Boyd in 
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